Intelligent Inventory Control: Is Bootstrapping Worth Implementing?

نویسندگان

  • Tatpong Katanyukul
  • Edwin K. P. Chong
  • William S. Duff
چکیده

The common belief is that using Reinforcement Learning methods (RL) with bootstrapping gives better results than without. However, inclusion of bootstrapping increases the complexity of the RL implementation and requires significant effort. This study investigates whether inclusion of bootstrapping is worth the effort when applying RL to inventory problems. Specifically, we investigate bootstrapping of the temporal difference learning method by using eligibility trace. In addition, we develop a new bootstrapping extension to the Residual Gradient method to supplement our investigation. The results show questionable benefit of bootstrapping when applied to inventory problems. Significance tests could not confirm that bootstrapping had statistically significantly reduced costs of inventory controlled by a RL agent. Our empirical results are based on a variety of problem settings, including demand correlations, demand variances, and cost structures.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Investigating Impact of Intelligent Agents in Improving Supply Chain Performance

Improvement in supply chain performance is one of the major issues in the current world. Lack of coordination in the supply chain is the main drawback of supply chain that many researchers have proposed different methodologies to overcome it. VMI (Vendor-managed inventory) is one of these methodologies that implementing it has some obstacles. This paper proposes new model that is agent-managed ...

متن کامل

Bootstrapping a Socially Intelligent Tutoring Strategy

We present an approach for computer supported education in the form of a socially intelligent learning environment that is available online. It integrates problem solving and instructional materials into individual and group learning scenarios. A Wizard-of-Oz-driven computer tutor accompanies students to maintain their motivation within the learning environment. The agent can hold off-task conv...

متن کامل

Generation of multiple synthesis inventories by a bootstrapping procedure

In concatenative speech synthesis systems the generation of a unit inventory is a tedious task. Hovewer, some applications demand multiple voices. A semiautomatic method to generate unit inventories is proposed. The units are segmented out of carrier phrases by means of dynamic time warping alignment with a synthesized utterance. This requires at least one existing inventory. The availability o...

متن کامل

Using Data Mining Techniques for Intelligent Diagnosis of Severity of Depressive Disorder

Introduction: Implementing a method that can help individuals diagnose or prevent mental disorders can be an important step in preventing and controlling these disorders especially in the early stages. The objective of this research was to apply data mining techniques for intelligent diagnosis of severity of depressive disorder. Method: The present applied research was carried out by going to a...

متن کامل

An Intelligent RFID-based Electronic Anti-Counterfeit System (InRECS) for the Manufacturing Industry

Radio Frequency Identification (RFID) is a potent technology that manufacturing enterprises can deploy to enhance supply chain management, inventory control and asset management effectiveness. However, counterfeit prevention is seldom addressed in these RFID applications. The quality image of reputable manufacturers is vulnerable to the damage caused by the expanding flow of counterfeit product...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012